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Abstract 

In the first part [9] of this article series, Bourgade, Yau and the author of this paper proved a local 
version of the circular law up to the finest scale A^^^''-^+^ for non-Hermitian random matrices at any 
point z £ C with — 1| > c for any c > independent of the size of the matrix. In the second part [lOj . 
they extended this result to include the edge case |2:| — 1 = o(l), under the main assumption that the 
third moments of the matrix elements vanish. (Without the vanishing third moment assumption, they 
proved that the circular law is valid near the spectral edge \z\ — 1 = o(l) up to scale A^"^'' In this 
paper, we will remove this assumption, i.e. we prove a local version of the circular law up to the finest 
scale iV-i/2+= for non-Hermitian random matrices at any point z G C 
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1 Introduction and Main result 



The circular law in random matrix theory describes the macroscopic limiting spectral measure of normalized 
non-Hermitian matrices with independent entries. Its origin goes beck to the work of Ginibre |18| . who found 
the joint density of the eigenvalues of such Gaussian matrices. More precisely, for a.n N x N matrix with 
independent entries -^Zij such that Zij is identically distributed according to the measure = ;^e~l^l dA(z) 
(dA denotes the Lebesgue measure on C), its eigenvalues /ii, . . . , fipf have a probability density proportional 
to 

niM.-M.fe'^^^i'^^i^ (1.1) 

with respect to the Lebesgue measure on . These random spectral measures define a determinantal point 
process with the explicit kernel (see [18] ) 

K,iz„z,) = ^e-f (l-l^+l-l^) J: (1.2) 

with respect to the Lebesgue measure on C. This integrability property allowed Ginibre to derive the circular 
law for the eigenvalues, i.e., j^p{^^ converges to the uniform measure on the unit circle, 

-l|,|<idA(z). (1.3) 

TT 

This limiting law also holds for real Gaussian entries |14| , for which a more detailed analysis was performed 
in lilllllH]. 

For non-Gaussian entries, Girko |19| argued that the macroscopic limiting spectrum is still given by 
(|1.3p . His main insight is commonly known as the Hermitization technique, which converts the convergence 
of complex empirical measures into the convergence of logarithmic transforms of a family of Hermitian 
matrices. If we denote the original non-Hermitian matrix by X and the eigenvalues of X by , then for any 

function F we have the identity 

1 ^ ^ r 

]^E^(A^^-) = ri^ / A^^(z)Trlog(X*-z*)(X-z)dA(z). (1.4) 

Due to the logarithmic singularity at 0, it is clear that the small eigenvalues of the Hermitian matrix 
{X* — z*){X — z) play a special role. A key question is to estimate the small eigenvalues of {X* — z*){X — z), 
or in other words, the small singular values of {X — z). This problem was not treated in [T^, but the gap was 
remedied in a series of papers. First Bai [3] was able to treat the logarithmic singularity assuming bounded 
density and bounded high moments for the entries of the matrix (see also |4]). Lower bounds on the smallest 
singular values were given in Rudelson, Vershynin [26l[27], and subsequently Tao, Vu [30], Pan, Zhou [23] 
and Gotze, Tikhomirov [20] weakened the moments and smoothness assumptions for the circular law, till 
the optimal L^ assumption, under which the circular law was proved in |31| . On the other hand. Wood [33] 
showed that the circular law also holds for sparse random n by n matrices where each entry is nonzero with 
probability n"~^ where < a ^ 1. 

In the first part of this article j^, Bourgade, Yau and the author of this paper proved a local version of 
the circular law, up to the optimal scale A^"^/^"*"", in the bulk of the spectrum. In the second part [1^, they 



2 



extended this result to include the edge case, under the assumption that the third moments of the matrix 
elements vanish. (Without the vanishing third moment assumption, they also proved that the circular law 
is valid near the spectral edge |z| — 1 = o(l) up to scale N~'^/^~^'^ .) This vanishing third moment condition 
is also the main assumption in Tao and Vu's work on local circular law |32| . In the current paper, we will 
remove this assumption, i.e. we prove a local version of the circular law up to the finest scale A^^i/2+'^ for 
non-Hermitian random matrices at any point z g C. 

More precisely, we considered an N x N matrix X with independent rea|3 centered entries with variance 
N^^. Let i^Lj, j e Il,-/V]l denote the eigenvalues of X. To state the local circular law, we first define the 
notion of stochastic domination. 

Definition 1.1. Let W = W^^^ be a family of random variables and ^ = he a family of deterministic 

parameters. We say that W is stochastically dominated by ^! if for any a > and D > we have 

\W\ > TV"*] N-^ (1.5) 

for sufficiently large N . We denote this stochastic domination property by 

^ or VF = 0^(«'). 

Furthermore, Let U^^^ be a possibly N-dependent parameter set. We say W{u) is stochastically dominated 
by '^{u) uniformly in u £ [/(^\ if for any cr > and D > we have 



sup . 



W{u)\ > N^^iiu) ^ (1.6) 



for uniformly sufficiently large N (may depends on a and D). 

Note: In the most cases of this paper, the t/^^'' is chosen as the product of the index sets 1 ^ i, j ^ N 
and some compact set in C^. 

In this paper, as in [5], |10| and |32| . we assume that the probability distributions of the matrix elements 
satisfy the following uniform subexponential decay property: 

y/NX,,^ \ > a) t^-^e"^'' (1.7) 



sup 

(ij)ell.Arp 

for some constant i? > independent of N. This condition can of course be weakened to an hypothesis 
of boundedness on sufhciently high moments, but the error estimates in the following Theorem would be 
weakened as well. 

Let / : C — > M be a fixed smooth compactly supported function, and /zo(m) = A^^'*/(A^*(/i — zq)), where 
zq depends on N, and s is a fixed scaling parameter in [0, 1/2]. Let D denote the unit disk. Theorem 2.2 of 
[S] and Theorem 1.2 of jTU] assert that the following estimate holds: (Note: Here ||/zo||i = 0(1)) 



(^N~'T.fM-l^ |^A„(z)dA(z)j -< iV"i+2s^ 5 e [0,1/2], 



(1.8) 



^For the sake of notational simplicity we do not consider complex entries in this paper, but the statements and proofs are 
similar. 
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if [9] ||zo| — 1| > c for some c > independent of or [10] ^Xf^ ~ for any 1 ^ i,j ^ A^. This implies 
that the circular law holds after zooming up to scale A^~i/2+'^ > 0) under these conditions. In particular, 
there are neither clusters of eigenvalues nor holes in the spectrum at such scales. We note that in (§] and 
|10| . the scaling parameter was denoted as a, but the letter a will be used as a fixed index in this work. 

We aim at understanding the circular law for any zq G C without the vanishing third moment assumption. 
The following theorem is our main result. 

Theorem 1.2. Local circular law: Let X be an N x N matrix with independent centered entries of variances 
1/N. Suppose that the distributions of the matrix elements satisfy the subexponential decay property il.7\} . 
Let fzg be defined as above p.Sp and D denote the unit disk. Then for any s G [0, 1/2] and any zq € C, we 
have 

^"'E/^o(M,)-^^/.o(^)dA(z)j -< N~'+'\ (1.9) 

Notice that the main new assertion of (jl.9p is for \zq\ — 1 = o(l) and ^Xfj ^ since the other cases were 
proved in [9] and |10| . stated in (jl.Sp . 

Remark: Shortly after the preprint [9] appeared, a version of local circular law (both in the bulk and 
near the edge) was proved by Tao and Vu |32j under the assumption that the first three moments of the 
matrix entries match a Gaussian distribution. 

In the next section we will introduce our main strategy and improvements. 



2 Proof of Theorem 11.21 

Proof of Thm. The bulk case of Thm. 11.21 was proved in Theorem 2.2 of IH]. Hence in this proof, we 

can assume that 

||zo|-l|=o(l), s>0 

In the edge case, our Thm. 11.21 was proved in the Thm 1.2 of [10] with the assumption ^Xf^ = for all 
^ ^ hj ^ N. Hence the goal of this paper is to improve the proof of Thm. 1.2 of [10]. One can easily check 
that in the proof of Thm. 1.2 of [10], the condition EXf^ = was only used in the Lemma 2.13 of |10| . 
Therefore, we only need to prove a stronger version of Lemma 2.13 in [lOj , i.e., the one without vanishing 
third moment condition. More precisely, it only remains to prove the following lemma [^21 (Here we use the 
same notations as in |10) . except for the scaling parameter) 

□ 

Before stating lemma ??, i.e., the stronger version of Theorem 1.2 of [10], we introduce some definitions 
and notations. First, we introduce the notation 

Y X ~ zL 

where / is the identity operator. In the following, we use the notation A ^ B when cB ^ A ^ c^^B, 
where c > is independent of N . For any matrix M, we denote as the transpose of M and M* as the 
Hermitian conjugate. Usually we choose z — zq '-^ , hence we define the scaled parameter ^: 

z = zo + N-'^, I.e., ^ := 7V"(z - zq) 
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Define the Green function of Y*Yz and its trace by, wliere w € C and Imw > 0, 

1 1^1 
Giw):=G{w,z)^{Y:Y,~w)-\ m{w) -.^ m{w, z) ^ - Tr G(zi;, z) ^ - ^ . (2.1) 

As proved in [3] and |10| . for some regions of (w,z), with high probabiUty m{w,z) converges to mc(w,z) 
pointwise, as, N ^ oo where TOc := mc{'w, z) is the unique solution of 

= --u;(l + mc) + |zp(l +mc)"^ (2.2) 

with positive imaginary part. Let pc be the measure whose Stieltjes transform is nic- This measure is 
compactly supported and supppc = [max{0, A_}, A+], where 

A±:=A±(z):=^=^, a := yiTW- (2-3) 

Note that A_ has the same sign as |z| — 1. It is well-known that pc{x,z) can be obtained from its Stieltjes 
transform mc(.T + vq, z) via 

/9c(a;,z) = -Im lim TOc(a; + i?7, z) = il^grn,ax{o,A_}.A+] Im lim mc{x + irj , z) . 

(Some basic properties of rric and pc were discussed in section 2.2 of |10| ) 

Definition 2.1. (p, x, I and Z\^'^ 

Let h{x) be a smooth increasing function supported on [1, +oo] with h{x) = 1 for x ^ 2 and h{x) = for 
X ^ 1. For any e > 0, define (j) on M_|_ by (note: A+ depends on z) 

0(x) := 0e,.(x) h{N'~^'x) (logx) (1 - (x/(2A+))) . (2.4) 

Let X be a smooth cutoff function supported in [—1, 1] with bounded derivatives and xiv) — 1 \y\ ^ 1/2- 
Recall dA denotes the Lebesgue measure on C, for any fixed function g defined on C, we define: 



and 



(s) — N / Ag(e) / xivWiE) Rc(m(w) - mciw))dEdr]dA{^), w^E + ir], z^zq + N'^S, 



I := L, := eC: N-^+^'Ve ^T], E ^ N-^+^'', \w\ e, w = E + ir]Y (2.5) 

Note: the condition E ^ 7V~2+2e .^^g ^^^^ definition of / in pj], but clearly this condition is implied 

by (j)' (E) ^ 0, i.e.. our new / does not change the value of z''-^\. One can also easily check: 

w L^ =^ \w\^l'^ s^2N^-^ri (2.6) 

With these notations and definitions, we claim the following main lemma. It is a stronger version of 
Lemma 2.13 in jlO], i.e., the one without vanishing third moment condition. 

Lemma 2.2. Under the assumptions of Theorem \L2\. there exists a constant C > such that for any small 
enough e > (independent of N), ||zo| — 1| e, < s < 1/2 we have 

Z^Jl -< N^'cf, 
where Cf is a constant depending only on the function f . 
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We note that the bounds proved in )10] for G^'s are not strong enough for our purpose in this paper. 
Unfortunately we noticed that it seems impossible to improve these bounds in general cases. On the other 
hand, we found that though the behaviors G's and Q^s are unstable in the region |77i| ^ (TV 77)"^, they are 
very stable in the region |m| ^ (Ni])^^ and many stronger bounds can be derived in this region. Therefore, 
in the following proof, we separate the Zx,c into two parts: the one comes for the region |m| ^ {Ni])^^ and 
the one comes for the region |m| ^ (A^yy)"^. The first part can be easily bounded, since the m is small, so 
as its contribution to Zx,c- For the second part, we will apply Green's function comparison method (which 
was first introduced in |15| for generalized Wigner matrix) and our new stronger bounds. 

On the other hand, the old Green's function comparison method was not enough for our purpose, which 
is also the reason that in [TU], the authors needed the extra assumption KXfj ~ 0. In this work, we will 
introduce an improved Green's function comparison method, which provides an extra N"^^"^ factor than the 
previous method. This idea was motivated from the work in [6] . 

Definition 2.3. tx and A^^ 

For N X N matrix X , we define 

tx ■.= txie,w,z) := N-'^NrjRem (2.7) 



tx ■■= N-^i]ReTT{{X* - z*){X - z) - w)"^ (2.8) 

Now we extend the function h defined in Def. \2.1\ to the whole real lane, i.e., h{x) = h{—x), hut still use 
the same notation, with these notations, we define: 



A'^P ■.^A'^Pizo,e,s)^N J AfiO J^x{v)^'iE)(^h{tx)Rcm~Rcm,yEdr]dA{0, 



(2.9) 



where z = zq + N '^^,w^E + iri,(f>~ (f)^^^ and tx = tx{s,w, z). 



Since the difference of A^"* and only contributed from the region | Reml ^ 2N^{Nr]) ^, then by 
definition, it is easy to see 

l^x - 4^il / \Afmjx{v)W{E)\ {2N'{Nrj)-') dEdrjdA{0 < N^'cj (2.10) 

where we used |(1 - h{tx))Rcm\ 2N'{Nrj)~^. 

Proof of Lemma\K^ With (|2.10p . it only remains to prove that 

Lemma 2.4. Under the assumptions of Theorem \1.2l there exists a constant C > such that for any small 
enough e > (independent of N), i/||zo| — 1| £ and < s < 1/2, we have 

A^ < N^^Cf (2.11) 

□ 
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2.1 Basic strategy of proving Lemma [2T4l Before we give the complete proof of this lemma, we introduce 
the basic idea and main improvement in the remainder of this section. Lemma 12.21 was proved in |10| under 
the vanishing third moment condition. With (|2.10l) . it implies that if ^Xfj = 0, for all 1 ^ i, j ^ N , then 
for any fixed p G 2N, 

lEI^Sr -< N^'", ^Xfj = (2.12) 

( f ^ 1—1 

As one can see that A-^ is basically a linear functional of ■m{w,z). Hence to prove this lemma, as in |10| . 
we will apply the Green function comparison method to show that for uniformly sufficiently large A^. 

E|A^V C'JEIA'^^Ip + TV^^p, (2.13) 

where X and X' are two different ensemble, whose matrix elements have different distributions. In this 
paper, we will choose X' to be the one whose third moment is 0. (In [TO], the authors estimated the E|Zj^ ^j^* 

with Elzj/^^l^, as in (j2.13p . where ^Xf^ = and X' was chosen to be the Ginibre ensemble, whose matrix 
elements are Gaussian variables.) Combining (|2.12l) and (|2.13p . with Markov inequality, one immediately 
obtains Lemma 

In applying the Green function comparison method, we estimate the expectation value of the functionals 
of y's, G"s and Q^s. In |10| and most applications of Green function comparison method, one can only bound 
the expectation value of these functionals with their stochastically domination. For example, in [TO], for 

i j and \w\^^'^ <€. (Nrj), one has 

\iYGU^C{\ogNf 

With this stockastically domain, the authors obtained that (as in [10]) |E(yzG')ij| ^ C(logA^)^. In the 
present paper, under the condition Rem ^ ('r]N)~^, i.e., h{tx) > 0, we will first show an improved bound: 
for i ^ j and < (iVry) 

\h{tx){Y,G),,\ ^ C(logiV) 

Then using a new idea on Green's function comparison method, we will show that the expectation value of 
this term will obtain an extra factor N~^/^, i.e., 



\Eh(tx){Y,GU ^ CA-i/^M^ (2.14) 

This extra factor N^^^"^ plays a key role in our new proof. A similar method was used in the [5]. 

Now we explain the basic idea of proving (|2.14p -tvpe bounds. Let fJ*'*^ be the matrix, which is obtained 
by removing z— th row and column of y^, and define 

We write h(tx){YzG)ij as the polynomials of the i— th row/column of X: Xik, Xki (1 ^ fc ^ A^), G'-''*'' and 
g'^'''^ i.e., 

h{tx){Y,Gh, = P(A,fc, Xk,, G^'^'\ e('^*)) + negligible error 

where P is polynomial. Clearly Xik, Xki are independent of G*^*''^ and g^'^''^\ In this polynomial, we will 
show that the degrees of every monomials w.r.t. Xik and Xki^s are always odd numbers. Therefore, if taking 
the expectation value, with assumption EA^ = and |EAJ^j | ^ 0{N~''^^), one will see an extra combination 
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factor N The following simple example will show why the odd powers give an extra factor N ^1"^. 

Suppose we estimate "S.Y.kst^'^k^tf' ^i'^^'^lt^ Since EXy = and |EX*^| 0{N-^l'^), the nonzero 
contribution only comes from the terms where k = s = t, therefore 

|E Vx,fe4y')x,,Gir^^t.| = |E Vx.fcCif '^.fcCir^X,,! CiV'i/2E(max|Gir^l)' 

' ^ — ah 

kst k 

On the other hand, without E, this term can only be bounded without this N^'^^^ factor (with large deviation 
theory) . 

\J2x,,G'ii'^X,sG^'^X,,\ ^ (logiV)^(max|Gi^^)|)2 

^ — ^ ab 

kst 

Note: one will not see this 7V^^/^ factor if the degree is even number, e.g., Ej^-^isG^st^^Xu- Based on this 
new idea, the main task of proving lemma and (|2.14p -tvpe bounds is writing the functionals of Y^^s, G's 
and ^'s as the polynomials of Xik, Xki (1 /c iV) , G^*-') and ^('''^ for some 1 ^ i ^ N, (up to negligible 
error) and counting the degree of each monomial. 



3 Proof of Lemma [231 

In this section, we apply the Green's function comparison method to prove the Lemma 12.41 First of all, we 
state the following lemma. It will be used to estimate the expectation value of some random variables which 
are stochastically dominated, but not Loo bounded. 

Lemma 3.1. Let v = w*-^' be a family of centered random variables with variance 1/N, satisfying the sub 
exponential decay (|1.7[) . Let A ~ A^^'^ and A ~ A^^-* be families of random variables. Suppose A ^ 1, and 
A = X]n=o^"^"' where ^ N for some fixed constant G > 0. We also assume that A is independent 
of V and \A\ ^ for some G > 0. Then for any fixed p G N and fixed small 5 > 0, 

\EAAvP\ ^ (E|I|)Ar-P/2+<5 ^ ^-i/s ^3 

for large enough N . 

Note: Here A or ^^'s may depend on v. 

Proof of Lemma COl - By definition 1 1.1[ A ^ 1, and the fact that v has sub exponential decay (|1.7p . for 
any fixed 6 > and D > there is a probability subset such that P(il) ^ 1 — N^^ and in fl 

Then 

\EAAvP\ ^ {E\A\)N-P/^+^ + lEn-^ AAvP\ < iE\A\)N-P^^+^ + 0{N-^/^+^^) (3.2) 

for the second inequality, we used Cauchy Schwarz inequality. Choosing large enough D, we complete the 
proof of lemma 13.11 

□ 

Because of this lemma, for random variable v, we define 

Miv) := |a : A = II l^-l < ^ e n| (3.3) 
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Now we return to prove Lemma 12.41 

Proof of Lemma \K^ ' Let X and X' be two ensembles which satisfy the assumption of Theorem ll.2l To 
prove Lemma [2.41 as we explained in the beginning of subsection 2.1, near (|2.13p . one only needs to show 
that for any fixed e > 0, < s < 1/2, and p e 2N, if ||zo| - 1| < e then 



(3.4) 



for large enough N. For integer fc, ^ fc ^ N'^, define the following matrix Xk interpolating between X' 
and X : 

X{i,j) if N{i-l)+j 
X'{i,j) if k<N{i-l)+j • 

Note that X' — and X = X^2. As one can see that the difference between X^ and Xk-i is just one 
matrix entry. We denote the index of this entry as (a, 6) := (ak,bk) (a^, 6^ S Z, 1 ^ cik,bk ^ N), here 
k=iak-l)N + bk 

Furthermore, we define tx^_i, txk, -^x _ j ^x with X^-i and Xk, as in Def. 12.31 We are going to show 
that if this special matrix entry is in the diagonal line, i.e., a — b then 



otherwise, i.e., a ^ b, 



E A 



J<-k 



E A 



2E A 



l(/) 



(3.5) 



(3.6) 



for sufficiently large N (independent of k). Clearly, (|3.5p and (|3.6p imply (|3.4p . 

We are going to compare the these functionals corresponding to Xk and Xk^i with a third one, corre- 
sponding to the matrix Q hereafter with deterministic (a, b) entry. We define the following N x N matrices 
(hereafter, = Xi — zl, £ — k or k ~ 1): 



V = VabGab = X' {a, b)eab, 


(3.7) 


U = UabGab = X{a, b)eab, 


(3.8) 


Q = Xk-i - V ^ Xk - u, 


(3.9) 


Q = Yk-i - V ^Yk - u, 


(3.10) 


R= iQ*Q -wl)-^ 


(3.11) 


n={QQ* -wl)-^ 


(3.12) 


s = (y;_in-i - wir^ 


(3.13) 




(3.14) 



Furthermore, we define i;?, A^-'^ with Q, as in Def. 12.31 and introduce the notations 

V Q 

ms = Tr S, tjir = Tr R, ^ Tr T 

We note: with Cauchy's interlace theorem, we know that for some C > 0, 

\ms — mfj\ ^ C{N7])~^ , rj = Imw 



(3.15) 
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AxL-A'~'\^C (3.16) 



holds for any w and z. It implies 

_ 4(/) 
Q 

Now we study the difference between S, R and T in the parameter sets: 

{{k,z,w) e Z X : Of^k^N'^, \\z\ - 1| 2^, w e (3.17) 
Recall in (3.59) of [2] and the discussion below (3.61) of [2], it was proved that with the notations: 

Pi(Q) :- ^ Re {-2{QR\i,) (3.18) 

P2iQ) := ^ RC (wTZaaiR^U + 2{QR^)ab{RQ*)ba + {Q Q* ) aaRbb) 

PsiQ) ■■= 

^ Re {-2{RQ*)l^{QR^)ab - 2{RQ*)ba{QR^Q*)aaRbb - 2{RQ*)baWTZaaiR^)bb - 2wTZaaRbbiQR^)ab)) 

the difference between Re 7715 and Rem^j, i.e., (-^ RcTr — jj ReTri?) can be written as 

RCTO5 - RcrriR ^Y,P^{Q) ■ {vab)^ + Pi{Xk-uQ) ■ {vab)\ (3.19) 

n 

where P4(Xa;_i, Q) depends on Xk-i and Q, and the P's can be bounded as 

Pi{Q). P2iQ), PsiQ), Pi{Xk-i,Q) -< iN7])-\ (3.20) 

uniformly for (fc, z, w) in p.l7p . In [2], the uniformness was not emphasized, but it can be easily checked. 
Note: From (|3.9p - p.l2p and the definition of Pi.2,3{Q); we can see that Pi.2,3{Q) only depend on Q and 
they are independent of Vab- 

For Lao norm, by definition, it is easy to prove that the following inequalities always hold: 

||7^||, WQRl WQR^, \\QR^Q*\\ ^N^' (3.21) 

for any {k,z,w) in (|3.17p and some fixed constant C > 0. Then with the definition in p.lSp . we also have 
that for any (fc, z, w) in p.l7p and some constant C > 

Pi,P2,P3^0iN^). (3.22) 

Expanding S around i?,we obtain that for any fixed m G N 

m 

S-R = J2 i-Ri^kYk - Q*Q)T R + {-RiYkYk - Q*Q)r^' S (3.23) 

n=l 

Let m = 5 in (|3.23p . Taking RcTr on the both sides of p.23p . comparing it with p.l9p . we can see that 
for 1 ^ Z ^ 3, the Pi{Q) is the coefficient of the («„&)' term in the r.h.s. of RcTr (|3.23D and 

P4iXk-i,Q)eMivab) (3.24) 
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Similarly, using this expansion (m ~ 5), and the fact: 

d^R = i?2 = 0(7V^), d,R = R{Y + Y*)R = 0{N'^), 
so as dwS and dzS, we can improve p.20p to the following one: 

, max iV77(|Pi(g)| + |P2(Q)| + |P3(Q)| + |P4(^fc-i,0)|) ^ 1 (3.25) 

We note: this statement shows that p.20p can hold for different {k, z, w) G p.l7p with the same probability 
subset. 

Using Taylor's expansion and letting /i^*^' be the fcth derivative of h, we have 

3 

h{tx^_jRems - h{tQ)Remn =^ {Rems - Remji)" + Bi{Xk-^i,Q) {Rems - Rem^y (3.26) 

n=l 

where for 1 ^ n ^ 3, 

B«(Q):-^(iVi-,7)("-i)(W"-i)(t^) + /»(")(i^)tQ) (3.27) 

B,{Xk-uQ) := Y^iN'^'vf (4/i(^'(C) +/^<'HC)C) 

where Q is between tx^-i a-nd tg, and only depends on tx^-n iq a-nd h. As one can see that Bi, B2 and B3 
are independent of Vat- For the definition of _B's, we note that if n ^ 1, then 

/i(")(x) 7^0 =^ :r- 1 

Therefore, with \h\ ^ 1, we obtain the following uniform bounds for S's: 

\B,,\ ^ {N^~'ij)^"~^\ I5:n^4 (3.28) 

Inserting p.26p and p.l9p into A)^^ ^ — , we can write Aj^j^ ^ — Aq as a polynomial of Vat as follows. It 

is easy to check that the coefficients of (uo&)" (1 ^ n ^ 3) are independent of Vab- Denote ^n{Q), 1 ^ n ^ 3 
as the coefficient of (vab)"', i.e., 

^S-l - " ^'^^^ ■ + ^'^^^ ■ ^"""^^ ^^^^^ ■ + .^4(^fe-l,g) • (Vab)^- (3.29) 

A simple calculation shows that ^i(Q), ^2{Q) and >^3^3(Q) are independent of Vab, and 

^i(Q) :-7V y A/(C) y (i3iPi)x(77)<^'(i?)di?dr7dA(e) (3.30) 

^2(Q) ■.=N I AfiO l^{BiP2 + B2P?)x{riW{E)dEd7^dA{0 

^siQ) ■■=N J A/(C) [B^P-i + 2B2P1P2 + B^Pf)x{r]W{E)dEd7^dk{0 

^,{Xk^i,Q):=N f AfiO f (^i?„ {vab)'^^^'^'>-^f[P.,)x{vW{E)dEdvdA{0 
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where B„ = B„(Q), P„ - F„(Q) (1 ^ n ^ 3), B4 - B^iXk-uQ) and P4 = Pi{Xk-uQ). 

Replacing X^^i with X^, with the same method, we obtain (Here Vab is replaced with Uat) 



Xk Q 



(3.31) 



From p.28p and (|3.25p . it is easy to check that ^1, 0^2 and ^3^1 uniformly hold for k. For Lao bound, 
with (|3.22p . they are bounded by N'~^ for some C. Similarly, we can obtain that ^4 -< 1. With (|3.24p . we 
have ,^4(Xfe_i,Q) e M{vab) and J^4(Xfc,Q) S M{uab)- So far, we proved 



^1,2,3,4^1, ^1.2,3(Q) ^4(^fe-l,Q) eX(«ah), ^4 (^fc , Q) G (Wab) 

uniformly hold for ^ A: ^ iV^. We now decompose 

(41.)'' - = E h (4^^- ((41. - ^fy~^ - (^l - ^y-^ 



(3.32) 



Let A be the term containing wj^^ or Uq^'s in the r.h.s. More precisely, with (|3.29p and (|3.3ip . one have 

, .,^1 ,3 = Cp-Mfy-'^liQ) + C,,2{AfY-^3^r{Q)I^2{Q) + C,,i(4))''-i^3(Q) (3.33) 

^'^ahj \Uab) V V >Tf 

where Cp^„ (1 ^ n ^ 3) are constants only depends on p. Since the first two moments of Vab and Uab coincide, 
and Uab, Vab are independent of Q, using p.32p and Lemma |3. 11 we get 



EM 



p-1 



-|E-4|, 
(3.34) 

Similarly, using ([332| . (USSl), A^ = ©(A^*^), LemmaEH and the fact: Uab, Vab are independent of Q and 
Q, we have 



|Ey^| s$ (0^(1) +E|A^^V 



As in [2]-(3.64). using Holder's inequality and the bound p.l6p . we have 

p 

Q 



E|Ag)r^E((A(,ljp)+E 



E 



(/) 



if) 



p 



(0^(1) + 2E| 



A 



-E 



E 



A 



if) 



■)-E( 



Xk~l Q I 



(3.35) 



(3.36) 



Then combining ([XMIj - fX^ . we obtain dSH). (Note: p e 2Z.) 

To prove p.6p . we claim the following lemma, which provides the stronger bound on the expectation 
value of the r.h.s. of p.33p . 
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Lemma 3.2. Assume 1 ^ a ^ b ^ N. Let X he defined as in Theorem \1.S\. except that Xab — 0. For any 
fixed small enough e > 0, if \\zq\ - 1| < £ and s £ (0, 1/2), define PiiX), Bi{X), ^i{X), i = 1, 2, 3 as 

in (El]), ([XTB]) . (jXTT)) and Then 

K{A^Pf-^^l{X) + E{A^P)P-^^i{X)^2{X) + E{A'-P)p-^ ^3{X) ^ ('o^(l) +E|A^V 



uniformly for (a, b). 

Inserting this lemma into the r.h.s. of p.33p . as in p.35p . we obtain that if a 7^ 6, then 



\EA\ s$ N-^ (0^(1) +E|aI^V) 



(3.37) 



(3.38) 



Together with p.34p and (|3.36p . we obtain (|3.6p . Clearly, (|3.5p and p.6p imply (|3.4p . and we complete the 
proof of Lemma 12.21 

□ 



4 Proof of Lemma 

Let Y^""'""^ :— Yz "'''^^ be the matrix, which is obtained by removing the i— th row and column of Yz, and define 

As introduced in the end of subsection 12. 1[ the main strategy of proving Lemma 13.21 i.e., bounding the 
expectation values of some polynomials of Aj^ and ^i, 2,3(^)1 is writing them as polynomials of Xak, Xka 
(1 ^ fc ^ iV), G'^"'"-'^ and Q'^'^'"^) . Note: a and b appear in the definitions of Fi,2,3 and Bi,2,3. The ^1,2,3 are 
defined with Pi. 2, 3 and -61,2.3- 

In the first part of this section, we introduce some polynomials which have the properties we need for 
Lemma l3.2i i.e., whose expectation value have an extra factor N^^^^ than their stochastic domination. 



We first introduce some notations. 



Definition 4.1. Xf^.u)^ y(T,o)^ q{t,v) g(T,u) 

Let T, U be some subsets of {1, 2, • • • , A^}. Then we define F^^'") as the {N - |U|) x (iV - |T|) matrix 
obtained by removing all columns of Y indexed by i €z T and all rows of Y indexed by i (zV. Notice that we 
keep the labels of indices of Y when defining Y^'^''^\ With the same method, we define A^^'*^^ with X. 

Let Yi be the i-th column ofY and yl be the vector obtained by removing yi{j) for all j G §. Similarly 
we define y^ be the i-th row ofY. Define 



QiT,V) ^ r(y(T,U)^*y(T,U) 



(T,U) 



1 



N 

(T,0) 1 

e TV 



By definition, Since the eigenvalues ofY*Y and YY* are the same except the zero eigenvalue, 

it is easy to check that 

" (4.1) 



(T,U) 



(w) = mg + 



Nw 
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For |U| = |T|, we define 

There is a crude bound for (to^J'"^'' — m) proved in (6.6) of [S]: 



^(T,0) ^(T,U) ^ ^(T,U) 



(T,U) 



(T.U) 

rrig — m 



^ C 



m + iui 

Nri 



(4.2) 



(4.3) 



Definition 4.2. Notations for general sets. 

As usual, if X CzM. or C, and S is a set then xS denotes the following set as 

xS := {xs : s £ 5} 

For two sets Si and S2, we define the following set as 

Si ■ S2 ■■= {si ■ S2 I Si G Si, 52 6 52} 

For simplicity, we call s G„ S if and only if s can be written as the sum of finite (independent of N) elements 
in S , i.e., 



s e„ S <^=^ s e I'^sA Si e S, neN 



(4.4) 



Definition 4.3. Definition of Tq, Ti, J-1/2 and T. 

For fixed indeces a, b and ensemble X in lemma \3.2\ and C Cz N, we define Tq as the set of random 
variables which are stochastically dominated by 1 and independent of any Xak and Xka (1 ^ ^ *s N), i.e., 



■^Q = {V '■ ^ 1, is independent of the a— th row and column of X} 

For simplicity, we denote 

(a) (a) 

E-E' E-E 

Then we define T\ as the set {N^^^XaaJ'o) unites the set of some quadratic forms as follows 



(4.5) 



(a) (a) 

Ti := [N^/''Xaa^o) U <j ^Xfc.FMX,, or Y^XakVuXak 

kl kl 



max|Vfci| -< 1, Vki e J"o 

kl 



(a) (a) 

U { J2 XakVklXia + N^'^ J2 XakVkkXka 
k^l k 



maxlVfcil -< 1, Vki e J"o 

kl 



(Note it is XkaVkiXia or XakVkiXai in the first line and XakVkiXia in the second line, and the diagonal 
terms in the second case is allowed to be larger than the others by a factor N^/'^ .) 

Furthermore, we define T as the set of following random variables 



n=0(l) 



(4.6) 
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where (J-i)" represents the set of the products of n elements in J-i. 
Similarly, we define 



(a) (a) 

•^1/2 = { ^XakVk or ^ VkXka 
k k 



max|l^,Hl, FfcG J-Q^ (4.7) 



Note: For fixed k ^ a, the total number of Xak, in each monomial of the element in J- is always even, so 
as Xka ■ On the other hand, this number in ' is always odd. By the definition, it is easy to see that 

J-Q-^c^^a, a = 0, 1/2, 1, 

and 

-Fi/2--Fi/2C J-i, T-TcT (4.8) 

Definition 4.4. Uniformness Let Ft, T G T/v be a family of random variables, where T/v is parameter set 
which may depends on N . We say 

Ft e„ Te Tn, 
are uniform for all T G Tzv; */ the following two uniform conditions hold, 
(i) There exist uniform m, n independent of N such that for all T G Tn , 



i=l 

(ii) All of the stochastic domination relations, i.e., -<, appearing in all Ft 's (T G Tzv ) hold uniformly. 

Similarly, for To, T1/2 and T\, we call 

Ft^uT^, T^Tn. a = 0,1/2,1 

uniformly for all T G T/v, if there exist uniform m independent of N such that Ft — '^iLi TT,i o.n-d Ft^i G Ta 
and the above uniform condition (ii) hold. 

More general, we say 

Ft G„ FaFji, T G T/v, Ta, Ffi = T^, Fi/2, Fi, F 

uniformly for all T G T/v */ there exists uniform m independent of N such that 

m 

Ft = ^ FT,a,iFT,i3,i 
i=l 

and 

FT,a,i <= Ta, FT,l3,i G Fj3 

hold uniformly for all T G Tzv • 
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Furthermore, with fixed D > and random (or deterministic) variable ot, we say 
Ft G„ arV^ + 0^{N~"), J",, = To, -Fi/2, J^i, T 

uniformly for all T G Tzv */ Ft can be written as 

Ft — gtFt 1 ~t~ Ft 2 

where 

Ft,i e„ and Ft,2 < N''^ 

hold uniformly for all T £ Tn ■ 

Now we estimate the expectation values of the elements in J^'s. Let F1/2 <= -7^i/2: F e F. With large 
deviation theory, we can only obtain 

^1, ^ 1, Fi/2 • F ^ 1 (4.9) 
But we will show that the elements in F1/2 ■ F may have much smaller expectation value. 



Lemma 4.5. For fixed indeces a, h and ensemble X in lemma \ 3/A let Fa and F be two random variables 
bounded by N'~^ for some C, i.e., 

\Fo\ + \F\ ^ N^' 

We assume that 

Fq e N^Fq, and F e„ ^"1/2 • J" 

Then we have 

\EFoF\ ^ N-^^'^E\Fo\+ N-^ (4.10) 

for any fixed D > 0. 

Proof of Lemma \4.5\ For simplicity, we assume F Cz F1/2 ■ F (not €„). The general case can be proved 
with the same method. Furthermore, by definition, KFqF = if F G F1/2 ■ F^. Hence one only needs to 
prove the following case: for some fixed m, 

F- Fi/2FiF2F3---F™, F,/^eFy2, F,eFu 1 i ^ m (4.11) 

By definition, ^1/2^1^2^3 • • ■ Fm can be consider as a polynomials of XakS and XkaS {1 ^ k ^ N), 
whose coefficients are independents of the a-th row and column of X . Then, we can decompose F as 

F ^Fy^FiF2F3---F^ (4.12) 
= E E E E A{{hh^.^^,{s,U,^^,{t,} 

) I n("'^afci)'*'("'^fcia)*' ) 

Ti^2m+1 kiM.-.-.kn si,...,s„ ti,...,t„ J 



where fc^'s are all different in the summation, and -4(^{fci}i^i^„, {si}i^i^„, {ti}i^i^„ j is the coefficient of 

YYi=i{^akiy' {XkiaY^ and it is independent of the a-th row and column of X. We separate the parameter 
region into two cases. 
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First case: ki ^ a for all 1 ^ z ^ n. By definition of J^i, we have 

n 

1 s, + J2u = 2m + l) J|(7vi/2)mi„{.,,t,} (4^^3) 

where the last factor come from the N-^^^ factor in the definition of J^i. 

Second case: kj = a for some 1 ^ j ^ n. Since the fc,;'s are all different, hence the other fc^'s are not 
equal to a. Let Sj = s, tj = 0, we have 

\i: i^j I i: i^j 

By definition of J-i and J- , we know that for any 5 > Q and D > Q, there exists probability set 17, which is 
independent of the a-th row and column of X, such that P(17) 5^ 1 — , and the ^'s in (|4.13p and (|4.14p 
can be replaced with ^. More precisely, 

Inl^first easel ^ ^''r.h.S of g331), ljl|Aeeond easel ^ iV^.h.S of gH (4.15) 

With this and |Fo| + |i^| < A^*^, we have 

EFoF = ElnFnF + Eln^FoF = El^F^F + 0{N^^-^) (4.16) 

Hence to prove (|4.10p . we only need to bound MIqFqF. For the first case, i.e., ki ^ a {1 ^ i ^ n), using 
(|4.15p . and the fact that Fq and il are independent of the a-th row and column of X, we have 

^Y. Y '^nFoA(^{h}l<i^^n,{s^}l^^^n,{t^}l^^<n) ( ^[(^afcj'' (Xfc^a)*M 

= Y Y Y Y IElj^i^o-4({fc,}i^,^„,{s,}i^,^„,{tJi^,^„)E [[](XafcJ^-(Xfe,,)*' J 

n fei.fc2,...,fc„^a si,...,s„ ti,...,t„ \'t=l / 

^ E E E 1 (E + E ^» = 2™ + l) ( n 1 i'^^ ^ 1) 1 ^ 1) 1 i^^t^ ^ 0) (Ar-l/2)max{.,.t,}-2 j 
n {s,}{t,} \i=l J 

where the factor {N^'^/'^)^'^ — N-^ comes from summation of fc^ : 1 ^ fc^ ^ A^. It is easy to check: 

1 (S, 7^ 1) 1 {U 7^ 1) 1 {S^U + 0) (Ar-l/2)max{s,,t,}-2 ^ (^-l/2)l(s.+t,e2N-l) (-4^^^) 

Therefore, 

'^E E EE l^^^o-A({fc,}i^,^„,{s,}i^,^„,{tJi^,^„) [n(X,fcJ^'(Xfc^„)*-] (4.18) 
<(E|Fo|)iV-i/2+'5 
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Similarly for the second case: without loss of generality, we assume J — I. Then as above, using (j4.15|) . and 
the fact Q independent of the a-th row and column of X, we have 

^ E E E M E(^* + t.) e 2N + 1 j I n 1 (S. ^ 1) 1 iU + 1) 1 {S.U + 0) (iV-l/2)max{..,t.}+2 \ i^^\p^\^ 

s;(E|i^o|)iV-i/2+5 (4,19) 

Combining (|4J8l) and ([4T^ . we obtain Eloi^o-F -< (E|-Fo|) Then together with (|4l6| . we obtain 

(j4.10p and complete the proof of Lemma 14.51 □ 

Now we slightly extend the above lemma. Instead of assuming F — F Gn we assume that F — 

F £n Till + 0^{N-^) for some fixed D > 0. 

Corollary 4.6. For fixed indeces a, b and ensemble X in lemma \3.'A let Fq and F be two random variables 
bounded by N'-' for some C , i.e., 

\FQ\ + \F\i^N^ 

We assume that 

Fo e N^To 

and for some fixed D > 0, 

F=enT,^2-^ + 0^iN-") 

Then we have 

\EFoF\ -< iV-i/2E|Fo| +iV~-°+2^+^ (4.20) 

Proof of Corollary \4.6\ Write 

F = F^' + F" <En J'i/2 ^ (N^^) 

(Here M and e are for main and error.) For simplicity, we assume F™ E F1/2 ■ (not e„) and for some 
m ^ 0, F*^ e Fi/2{Fi)"^. By the definition of O^, T1/2 and J", for any S > and D > 0, there exists 

probability set fl, which is independent of the a-th row and column of X, such that P{il) 1 — N^^, and the 
^'s appearing in F^-' can be replaced with ^. More precisely, if x ^ y appearing in F^^, then Ifjx ^ N^y. 
Then we write 

\EFoF\ = \ElnoFoF\ + |ElnFoF*^| + |EloFoF^| 
= N-^+^^ + lEljjFoF^^I + lEljjFoF^I 

where we used |Fo| + |F| ^ N'~" . For |E 1oFoF^^|, since l^Fo G Fo, then we can use Lemma [4.51 and obtain 
that 

lElfjFoF^^I N-^^^+^E\Fo\ + 
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for any 6 > and D > 0. Therefore, 

|EFoF| = |ElocFoF| + |Elt|FoF^^| + \ElnFoF'\ (4.21) 

By the definition of -< again, there exists fl such that P(ri) 1 — N^^ and 

With this 51, we write 

lElaFoF^I ^ \El^^^FoF^\ + |E l,,^^.FoF^| (4.22) 



M\ 



For the last term, we note that by the definition of we can simply bound the term in F which are 
independent of the a-th row and column of X by TV*^'^. Then using the assumption F e -7-'j/2(-^i)"N we have 

2m+l / 2m+l ^ 

n— 1 \ki,k2,--- Mn j—1 

Together with F{ft H fl^) ^ N^-^ , and subexponential decay property (|1.7p . we obtain that 

Inserting it into (|4.22p and (|4.2ip . choosing large enough D, we obtain that (|4.20p and complete the proof. □ 



More general, if Ft &n J'i/2' ^ hold uniformly for T £ T, corollary 14. 61 can be extended to the following 
integration version. 

Lemma 4.7. For fixed indeces a,b and ensemble X in lemma lKM let Ft be a family of random variables such 
that for some deterministic xt and uniform D > 

FTenXTTi/2-T+O^iN''') 

hold uniformly for T E T = Tn , i-^-, Ft = F^^ + F^ and 

F^' G„ a;TJ"i/2 -F, F^ ^ 0^{N-'') 

hold uniformly for T Cz T = Tn ■ Here U nFn can be covered by a compact subset in W which are independent 
of N . We also assume that \xt\ + \Ft\ ^ for some uniform C > 0. Let Fq be a random variable satisfying 
Fo -< N^T and \Fo\ . Then 



EFo 



[ FtAT < N^^'''' {E.\Fo\) [ \xT\dT + N-^+^^+^ (4.23) 
JTer JTeT 
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Proof of Lemma \4. 7| Since Fq and Ft are bounded by , one can exchange the order of integration 
and expectation, i.e., 



JTeT JTeT 

Then with the uniforniness, one can easily extend the proof of Lemma 14.51 and coroUarv 14.61 and prove this 
lemma. 

□ 

The Lem. I4.5l and[ 4.7l are the key observations for the proof of Lemma [321 Now to prove Lemma [321 we 
claim that the following lemma, which shows that the terms in Lemma 13.21 can be represented by F''s and 
■ J^(with negligible error term). We first introduce a cutoff function on Rem*^"'"^. 

Definition 4.8. Define Xa as 

Xa ■.^Xa{e,w,z) = 1 (^|Rcto("-"'| > In'{N7])-'-^ (4.24) 
Note: By definition and (|4.3p . h{tx) > implies Xa = 1, and for any |U| + |T| = 0(1), we have 

h{tx)>0 =^ xa = l =^ |Rem("'T)| ^ iiV^'-^rr^ (4.25) 

Lemma 4.9. Recall X*-"'"' and m^"'"-' defined in Definition (j4.ip . Under the assumption of Lemma \S.'A for 
any fixed large D > 0, we have 

/i(tY)Rem- /i(tx(a,a))Rem("'") e„ J" + (iV"-°) (4.26) 

B^iX) eniNr])"'-'F+0^iN~''), m = 1,2,3 (4.27) 
XaPmiX)en^^i/2-^ + 0^{N-''), m = l,3 (4.28) 

XaP2{x) e„ -L^ + o^(iv-^) 

uniformly hold for 

Is^a^b^N, z : ||2| - 1| ^ 2£, and w e h- 

We postpone the proof of this lemma to the next section. Next we introduce a simple lemma for the 
calculation with J^'s. 

Lemma 4.10. Let A and B he two variables stochastically dominated by N'~^ for some C > 0, i.e., \A\ + \B\ -< 
N'-' . If for random variable Aq and Bq, we have 

A^Ao + O^iN-'^), B = Bo + 0^{N-''), 

for some D > 0. Then 

AB = AoBo + (N^-^) (4.29) 

Proof: By assumption, 

{A - 0^{N-")) {B - 0^{N-°)) = AoBo 
With \A\ + \B\ -< N^, we obtain g^S]). 
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□ 



Now we return to finish the proof of Lemma [ 
Proof of Lemma \3.2l ' For simpUcity, we introduce the notation A{w, z) as 

A{w, z) :~ h{tx) Re m{'w, z) — h{tx(a,a) ) Re m^"'"^ [w, z) 

First as in (|3.32p . ()3.28p and (|3.22p . one can see that there exists uniform C > 0, such that 



We write 



ra=l,2,3 



ri=l,2,3 



ri=l,2,3 



(4.30) 



By definition, for fixed with the notation A{'w, z) and (|4.25p . we can write: 



» i ^ i+3 J+3 

A 1 A ? I 1 A 1 



(4.31) 



where dT = J], d-B,;d7yjdA(^i) and T = (4 x supp/)'+3. Using (|430l) . Lemma l49l and Lemma [iTTOl for any 
fixed > 0, we have 

I ^ i+3 /i+3 ^ \ 

n^(^i'.,2.) n (Xa-PiSi)(u;„z,) e„ J]_ LFi/2-^ + 0^(iV-^) 



uniformly hold for T £T. Applying Lemma |47| by choosing )^"^"' as Fo, ( A^' - A^;'' 



as Ft, Yl^tfii-^Vi) ^ as .tt, and T = (/e x supp/)'+'^, with (|4.30p and Holder inequality, we obtain 



E 



Af) „ .(/) 



-< (o^ (1) + E (l ) (4.32) 

<N-'/' (o^(i)+E(i4i,„,r)) 



Similarly, we have 



E(A^^)P-3^3(X)| + |E(Al^y~2_^i(X)^2(^)| + |lE(Al^y~'^3(^)| ^ A^"'/' (0^(1)+e((A^(^„,„,)p)) 

(4.33) 

It follows from that m - = 0{Nr]y^ . Then it is easy to check that lA*^^^ 

Inserting it into (|4.33p , we complete the proof of Lemma 



x{a,o.) - Ax ''\ ^ C. 



□ 
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5 POLYNOMIALIZATION OF GREEN'S FUNCTIONS 



In this section, we will prove Lemma 14.91 i.e., write the terms in (|4.26p as polynomials in IF ox IF1/2 ■ ^ (up 
to negligible error). Since the uniformness can be easily checked, we will only focus on the fixed a, b, z, w: 

l5;a7^6<iV, z : ||z| - 1| 2£, and w £ 4. 

First we need to write the single matrix elements of G's and Q's as this type of polynomials. To do so, 
we start with deriving some bounds on G's under the condition: 



Rem| ^ ^N^Ntj)-^ 



(5.1) 



5.1 Preliminciry lemmas. This subsection summarizes some elementary results from [H] and ^U\. Note that 
all the inequalities in this subsection hold uniformly for bounded z and w. Furthermore, they hold without 
the condition (|5.ip . 

Recall the definitions of G*^^^', G^'^^^K y^ and y^ in the definitfon Ol 

Lemma 5.1 (Relation between G, G^^'®-' and G^"'^-'). For i,j^k ( i ~ j is allowed) we have 



G 



(fcj) _ ^ _ GjkGkj ^(0,fc) _ ^ _ QikQk] 
<^kk ykk 

(Gy*)(y,G) 



/-.(0,^) ^ r< I K'^yj ) \y i^J c^G^^''^ (G^^-'V*) (yiG^*^-')) 



1 - y^Gy* 
(gy») (y*g) g ^ 



1 + y.G(0.'V* 



(5.2) 
(5.3) 



Definition 5.2. /n t/ie following, Ex means the integration with respect to the random variable X . For any 
T C Jl, A^J, we introduce the notations 

Zf) (l-E,.,)yf'G(^-^')yP* 

and 

ZP :=(l-E,Jyf>g(-^)yf). 

Recall by our convention that y^ is a N x I column vector and y^ is a I x N row vector. For simplicity we 
will write 



Z, 



m 



Lemma 5.3 (Identities for G, t/, Z and Z). For any T C |l,iV|, we have 



G 



(0.T) 



1 + m 



{ij) 



r(T) 



where, by definition, =0 i/i G T. Similar results hold for Q: 



(T,0) 



(T,0) 



l + m^'m.PGfn^ 



(T) 



(5.4) 
(5.5) 

(5.6) 
(5.7) 
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Definition 5.4 ( C-High probability events). Define 

if := (log7V)'°si°g^. 



(5.8) 



Let C > 0. We say that an N -dependent event $7 holds with C-liigli probability if there is some constant C 
such that 

P(r2'=) iv^cxp(-/) 

for large enough N . Furthermore, we say that U,{u) holds with C-liigh probability uniformly for u ^ Un , if 
there is some uniform constant C such that for any u G Un 



"{Vf'iu)) iV^exp(-^'^) 



for uniformly large enough N . 



Note: Usually we choose to be 1. By the definition, if some event VL holds with C-liigh probability for 
some C > 0, then 57 holds with probability larger then 1 — N^^ for any 77 > 0. 

Lemma 5.5 (Large deviation estimate). Let X he defined as in Theorem ] For any C > 0, there exists 
> such that for T C [l,iV]], |T| ^ N/2 the following estimates hold with C,-high probability uniformly 
for 1 i,j < N, \w\ + \z\ ^ C: 



.(T) 



^(T)| _ 



Furthermore, for i ^ j , we have 

(l-Ey..v.)(yPG(--^)yf>) 



(l-E,j(ypt;(-^)yf) 



Nri 



(5.9) 



Qd 



2 /Imm^*''"'^ + jzPlmf/, 



(»,T) 



where 



(T,ij) 



Imm^ + 




IzPlmGj-f^') 


Nr) 


Im,4'^'^' + 


.pimg(r'"^ + 


IzPlmtJ^p 




Nri 


7 




*g(y.T)y(T)^ = 





(5.10) 
(5.11) 



Lemma 5.6. Let X be defined as in Theorem lLSl Suppose \w\ + \z\ ^ C. For any C > 0, there exists such 
that if the assumption 

r]^ ip^-^N-^lwl^/^ (5.13) 

holds then the following estimates hold 

max\Gu\ ^ 2{\ogN)\w\-^/^ , (5.14) 
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max|«;||G,,||&[f'K(log7V)4 



(5.15) 



max|Gy| < C{\ogNf\w\-^^l^ 



(5.16) 



|m| ^ 2{\QgN)\w-'^/^\ 



(5.17) 



with Q-high probability uniformly for \w\ + \z\ ^ C. 



5.2 Improved bounds on G 's. 

The next lemma gives the bounds on G, G and m under the condition of | Rem| ^ i 
(1131), it imphes that for any U, T: \U\ + |r| = 0(1), 



1 . Note with 



|Rem(^'^)| > {Nt^)-\ 



(5.18) 



Before we give the rigorous proof for the bounds on G, G, we provide a rough picture on the sizes of 
these terms under the condition (|5.ip . w G and ||z| — 1| ^ 2e. We note that the typical size of the G^^'^-* 
heavily relies on whether k = I and whether k, I are in U, T. 



(i) If fc = ? ^ UUT, the typical size of G^"' ^(w, z) is m{w,z) = ^TrG(w,z). 

(ii) If fc 7^ and A:, / ^ U U T, the typical size of g["'^^ {w, z) is y/\m\/{Nr]). 

(iii) If {fc, Z} n U 7^ 0, then G^^'^"* = 0. This result follows from the definition, and it worth to emphasize: 



(iv) If fc = / e T, then the typical size of GJ.^,' is (wm) ^ 

(v) If fc 7^ and A: e T and ; ^ T, then the typical size of G^^'^^ is {\w'^/'^m\)-^ y^\m\/{Nri) 

(vi) If fc 7^ ^, and kJiET then the typical size of G^I^'^"* is |wto^| ^ y^\m\/{Nr]) 

(vii) With the definition of G^"''^) and ^^C^'") in Def. mH one can easily see that G^i '^'' has the same typical 
size as G^y'^'(Here (T,U) is replaced with (U,T)). 

We note: The m is bounded by {logN)'^\'w\^^^^ in (|5.17p (no better bound obtained in this paper), but 
it could be much smaller. 

Lemma 5.7. Let X be defined as in Theorem Let e be small enough positive number, \\z'^\ — 1| ^ 2e 

and w £ L^ (see definition in (|2.5p ). // (|5.ip holds , i.e., \Kcm{w, z)\ ^ jN'^{Ni])^^ in fl = ^l{e,w,z). 
Then there exists Q d Q, and G > such that holds in with 1-high probability uniformly for z, w: 




(5.19) 
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Il^^l — 1| ^ 2e and w 1^, and the following bounds hold in for any 1 ^ i ^ j ^ N 

\l + m\^ N^%Nr])-^ (5.20) 
|l + m(*'')| ^ Ni' Zf (5.21) 

Gt^"^ = (l + 0(iV-^^')) — — i— - (5.22) 

w 1 + m'-''*-' 

|l + m|~|TO| (5.23) 

\Gu\ ^ (logiV)^|m| (5.24) 

\Gr\^r^M (5-25) 
|Gi«-'''K (log7V)^|m| (5.26) 
l^r^K^ (5.27) 

(5.28) 

|u.G,,ri ^ iV^^|Z,| (5.29) 
|to(^'*)| ^ (logAr)-i (5.30) 

Furthermore, with the definition of G^^''^^ and Q^'^'^\ one can easily see that these bounds still hold under 
the following exchange 

g(U,T) ^^(T,U)^ ZoZ. (5.31) 

Proof of Lemma \5.7l In the following proof, we only focus on the fixed z, w, i and j, since the uniformness 
can be easily checked. 

We choose C = 1- Because (p <^ for any fixed e > (see (|5.8p ) and in this lemma w E I,., one can 
easily check that the assumption in this lemma implies the conditions of lemma [5^ i.e.. 

wele =^ (l?T^ holds for VCc (5.32) 

Therefore we will use the results (with C = 1) of Lem. 15.61 directly in the following proof. 

1. We first prove ([5?20| . The condition ([5T|) implies that \ j^J2i ReGji] ^ \N^Nr])~^, then there exists 
i : 1 ^ i sC iV such that \Gh\ ^ \N^Nr])-^. Together with (jSl^ . it implies that l^l^''"^] ^ \w\-'^ N-^' N?] 
with 1 - high probability in Q. Inserting it into (|5.6p with T = i, using g£*''' from (j5T9)) . we have 

|1 +m(''*) + I ^ iVi^(iV77)-i (5.33) 

Applying (|5.9p to bound Zj*-'-* with T = i, using Schwarz's inequality and the fact G^*'*'' = again, we obtain 

^ N-'^^Hmm'^'''^ +N'^^"{Nr,)-^ (5.34) 

holds with 1-high probability in D,. Together with (j5.33p . it implies that with 1-high probability in 51, 

|1 + m(*'') I ^ 2Ni''{NT])-^ (5.35) 
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Then replacing m^'^*) with m by (|4.3p . we obtain (|5.20p . 

2. For (|OT|l . first using and we have that for any i : 1 < i < 

|l + m('^*)| ^ Afi"(Arr/)-i (5.36) 

Irolds witlr 1-lrigh probability in 51. Together with the Z version of (|5.34p (whose l.h.s is we obtain 

(HOTD . 

3. For ((O^ . it follows from jUl) with T = ([5T^ and (|OT|l . 

4. Now we prove (|5.23p . Suppose (|5.20p . (|5.22p and (|5.9p holds in Hq C fl. From our previous results, Jig 
holds with 1-high probability in 51. Now we prove that (|5.23p holds in Oq. First we assume that |1 + m| ^3, 
clearly otherwise holds. Together with it imphes that (Ni^y^ ^ 3iV"^^ Using (g^l) and 
|1 + m| 3, we obtain |1 + 77i(''*)| < 4 and |mQ*'| < 5. With the bound |1 + m^''*)| 4 implies 
l^if'^^l ^ \5w\~^. The assumption w € 1^ implies |w| ^ e (see definition of in (|2.5p ). Then applying (|5.9p 
on and using H^j — 1| ^ 2e and the bounds we just proved on (Nrj)^^, "^g'*'' ^^'^ '^^ obtain that 
in 

\Z,\^N^^\G[t''^\ (5.37) 
Together with |Gjf''''| ^ |5u'|~"'^ and the assumption ||z| — 1| ^ 2£ and \w\ ^ e, we have 



^ \lOw\~^ (5.38) 



Now inserting (|5.38p into the identity (|5.6p with T = 0, using |m[?''''| ^ 5, and ^ s again, we obtain that 

G^^ 7 kf-, T < |60iz;|^ 1— ^ (5.39) 

~w {\z\^Gf'^ + Z,) |u.(|zPGlf-)+Z,)| 

Then together with (|5.37p and (|5.22p . in Hq, we have 

gu~\z\~^il + m^'-'^) ^ (100|u;| + o(l))|(l + m(''*))| (5.40) 
Combining (|5.20p and (|4.3p . we have 

(1 + m(*'^)) = (1 + o(l))(l + m) 

Inserting it into ()5.40p . we have 

|z|-2(i + „^)| ^ (200|w|+o(l))|(l+m)|, inflo (5.41) 
It is easy to extend this result to the following one: 

maxl^.i - |z|"2(l + m)| ^ (200|w| + o(l)) |(1 + to)|, in f2 (5.42) 

i 

holds in a probability set 51 C 51 such that 51 holds with 1-high probability in 51. Since m ~ Qn, for 

small enough e, with |ix;| ^ e and — 1| ^ 2e, (|5.42p implies that 

^|l + mK |m| sc; ^|l + m|, in O 
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It completed the proof of (|5.23p . 

We note: combining (g^]), and ([EISD, we have for any \U\, \T\ = 0(1), 

mf^^"^) - m - 1 + m - 1 + |C/|, |T| = 0(1) (5.43) 

5. For (|5:24| . it follows from IH^SKwith gl*'"^ in the l.h.s.), (IPS)) and ({51^ . 

6. For fOSl . first using ([531), (l5TTt . ((51^ and ((5TJ| . we obtain that 



« V^"IHIGf'l|Gir'n/ '°'"'°"";|f'"^'"' (5^44) 



holds with 1-high probability in Q. Applying (|5.15p on X^^'^^ instead of X. we obtain that 

kllG^f K(logiV)4 (5.45) 

Recall d^TID implies ^J^. Applying (j??^ on G'^j '\ we have that 

\G^''>\ ^ (log7V)^|m(*'^)| (5.46) 

holds with 1-high probability in fi. Then inserting ^M^, (lO^ and (|?^ into (|?^ . with ([CT7)) 

we obtain (|5.25p . 

7. For from ([O)) . we have 

" l+y,G(0.^-)y* ' 

On the other hand, (|5.6|) and (|5.12p show that (similar result can be seen in (6.18) of [9]) 

Then 

Gu = Gf'^ + wGrj ((G(®'-')X^),, - Gf^^'h*) ((XG^^^^)),. - G^'^ ^ (5.47) 

Since Xj-^'s (1 ^ fc ^ N) are independent of G'-"^-'-', using large deviation lemma (e.g. see Lemma 6.7 (S] ), 
as in (3.44) of HUI, we have that with 1-high probability. 



'ImGl«'^"> 



|(XG(«.^)),,| + |(G(«-)X^).,| ^ ^^y^^^^ (5.48) 



Inserting this bound, ([5^ . (|05)) and ((03)) into ((5?7|) . we have 

IG^.-Glf-'-^Kv'^^;!™! 



'imdf'^) 
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Then with ([5J4)) and ((5l7| . it implies 

and we obtain (|5.26p . 

8. For (|07|) . using ((5^ and ((?7Tg)l . we have 

Using (|5.9p and (|5.19p again, we can bound z[^''^ as 



Together with ((5^ and |?7i| ^ | Rem| ^ (iV77)"\ we obtain ((07|) . 
9. For using ([53)) . ((5TT|) and (|57T^ . we obtain that 



\G'ij\^V \w\\Gii\\G)j j;^ +(p'-\wz \\G^i\\G)j '\\gi/ '\ (5.49) 

Furthermore, with (|5?7|) . (|57TU)l and ([g?Tg|) . we have 

Here these two bounds holds with 1-high probability. As in (|5.46p . applying (|5.22[) on gjf''^\ we have 
with 1-high probability in fl. With (|5?M|) . (jOT)) and we also have 

|G,.K(iog7vfH, i^jlf )| + |e]f ^Kqz.riH-\ \m^^^''^\^c\m\, 

Furthermore, as in (|5.47p and (|5.48p . with (|5.19p . we have 

^(^0) _ ^(M) ^ ^gl^^^)(G(^^^)x^)^,iXG^^%, (5.51) 
= 0(^^|«;#«)|ImG(f)(iV^)- 

Then applying on Gj}'*\ and applying on gf-'''^ with (jglig)) we obtain that 

\Gff^\ < (logiV)^|™| 
Combining these bounds with (|5.49p and (|5.50p . we obtain (|5.28p . 
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10. For ((OQ)) . using dSJ]) (with T = 0) and ([5:22)) . (lOl , we have 



holds with 1-high probabihty in fl. Together with (|5.17p . we obtain 



12.1 ^ / l"-l + (l"H)-' ,5 



Together with ([5?24| and ([5T7|) . we have 



c 



Then with (g^l), we obtain ([E^ . 

11. For ([QO]) . we note that ((03| imphes |m| > (logiV)-^ Then with ([OSl . we obtain ([QO]) . 



□ 



5.3 Polynomialization of Green's functions: In this subsection, using the bounds we proved in the last 
subsection, we write the G's and Q^s as the polynomials in and ■F1/2 ■ (with negligible error). 

We note: In the Lemma [3.21 and l4!9l we assumed Xab ~ 0, but the bounds we proved in Lemma [5.61 and 
Lemma [5?fl still hold for this type of X, the detailed argument was given in Remark 3.8 of [2]. 

Lemma 5.8. Lemma [5. 61 and Lemma \5. 71 still hold if one enforces X^t — for some fixed 1 ^ s, t ^ N . 



Note: Here s,t are allowed to be the same as the i,j in Lemma 15.61 and Lemma 15.71 For example, from 
dS^Hl), we have \Gst\ ^ ip'^m^/^{Nri)-^/^, even if X^t = 0. 

By the definitions of A^', ^i,2,3(^), -Bi,2,3(X) and Pi,2,3(^), one can see that the values of A^' , 
^i,2,3{X) would not change if one replaced the G's inside with XaG's. Therefore, instead of G's, we will 
write XaG as the polynomials in J- and J- 1/2 ■J' (with negligible error). 

Definition 5.9. For simplicity, we define the notations: 



We collect some basic properties of these quantities in the the following lemma. 
Lemma 5.10. Under the assumption of Lemma \8/A for w € le 

XailogN)-' ^a^ (logNflS ^ [logNfr^-^ (5.55) 

Xa(log N)-^N-^^^ ^ 7 ^ N^i (5.56) 

/37'=Xa(A^^)"' (5.57) 

^ a ^Xailog Nf\w-'/^\ (5.58) 



Xa(logNf 



Nri 

hold with 1-high probability. 
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Proof of Lemma 1 5. 1 01 We note Xa = 1 implies the condition (jS.ip . Hence the resuhs in Lemma 15.71 
hold with 1- high probability. First from (|5.30p and \w\ ^ 77, we have the first and the third inequalities of 
(|5.55p . and the first inequality of (|5.56p . The second inequality in (|5.55p follows from (|5.f 7p and (|5.43p . It 
also implies the second inequality of (|5.58p . Combining the second inequality of (|5.55p with (|2.6p . we obtain 
the second inequality in (|5.56p . For (|5.57p . one can easily check this identity by the definition of /3 and 7. 
For the first inequality of ((535)l . it follows from ([00)) and □ 

Definition 5.11. Under the assumption of Lemma \3/A for w €E I^, \\z\ — 1| ^ 2£ and s^k ^ a, we define Sks 
and Ssk 0.S random variables which are independent of the a-th row and columns of X and 

M<l>,a) ^(0,a) 



''t^^H ^ksXsa and - J2 XsaSsk 



With (j5.5p . one can obtain their explicit expressions, e.g., 

(a) 



Sks-= z wGl^ 'gi^ ' - wG\^ ' }_^g\t 'Xtk (5.59) 



Similarly, we define Sks o,nd Ssk o-s random variables which are independent of the a-th row and columns of 
X and 

Qkf Qa^^ _ ~ 

- 2^ SksXas and - 2^ XasSsk 

i^aa s \Jaa s 

As one can see that S, S, S and S have the same behaviors. Here we collect some basic properties of 
these quantities in the the following lemma. 



Lemma 5.12. We assume that \\z\ — 1| ^ 2e, w £ Is, k ^ a and X satisfies the assumption of Lemma \3.2\ 

For some C > 0, with 1- high probability, we have 

\XaSks\^Xa'P^ [Ssk^l) (5.60) 

SO as S, S and S. Recall the definition T's in Def. for some C > 0, we have 

XaXaa 7-^: XaiXSX)aa 7-^i (5.61) 

and 

Xa{X^SSX)aa N^i^F (5.62) 

Furthermore, (j5.60p . (|5.6ip and (|5.62p hold uniformly for \ \z\ — 1| ^ 2e, w Cz and 1 k, s ^ a ^ N . 
Note: With (|5.6ip . we also have 

Xa (Ci^)) (XG(®''^)),, = Xa (g(®-)) ^-'^Gi^' = Xa {{XSXU + Xaa) 7-^ (5-63) 

k 

Proof of Lemma \5.12\ Since the uniformness are easy to be checked, we will only focus on the fixed z, 
w and k. 
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1. For (|5.60p . the condition Xa = 1 implies that we can apply Lemma [5. 71 on the X^"'"^. Recall: these 
bounds also hold under the exchange (|5.3ip . Then the bounds (|5.24p and (|5.25p imply that for s 7^ fc, 



holds with 1-high probability. Similarly (|5.22p and (|5.43p implies that for s = fc 

Xal^If Kqu;m('^'"^ri, s = k (5.65) 
holds with 1-high probability. Then with the explicit expression of in Del. 15.111 we have 

(a) 

XaSks = 0{5ks + V^^l) - ^Gir^ E ^If (5-66) 

t 

holds with 1-high probability. S independent of ^^^f '°^'s (1 i ^ N), using large deviation 

lemma (e.g. see Lemma 6.7 [5] ), as in (3.44) of (TUI, we have for 



holds with 1-high probability. Applying Lemma on the X*^"'"^ again, from (|5.26p . we have 

^ (logiV)g|m('--'-)|+CJ, \ 

with 1-high probability. Together with the first part of (|5.64p . (|5.66p and (|5.67p . we obtain 

\XaSks\ < GJ.fc + (^^7 + k'/'"^*"'"^l7 (5.68) 
with 1-high probability. At last, with (|CT7)) and (|?^ . we obtain 

2. For (|5.6ip . we recall the definition of in Def. 14.31 especially the two N^^"^ factors in T. Then it is 
easy to see that (|5.6ip follows from the first inequality of (|5.56p and the bounds on 5* in (|5.60p . 

3. For (|5.62p . since the (|5.60p holds for S and 5, then with the first inequality of (|5.56p . we have 

\Xa{SS)u\ ^ {Ski + 7 + ^7') ^^Nj^ 
with 1-high probability. Together with definition of we obtain (|5.62p . 

□ 

Now we introduce a notation to track the dependence of the random variables on the indices. First we 
introduce a simple example to show the basic idea. Let Aki, l^k,l^Nhea family of random variables: 



\GtC\\G\i 



L_(^G("-")X^),,, \i^k,l^^N (5.69) 
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where is the transpose of X. By definition of J- and J-q, we can say, 

Aki £ J^o ■ J^o ■ ^ 

But the first part of the r.h.s. of (|5.69p . i.e., only depends on the first index k, the second part ^^j'^ 

only depends on the second index I and the third part is independent of the indices. Therefore, we prefer to 
write it as 

More precisely. Am G 4^' • 4'' ' means that Am = h{k)f2{l)h and h{k) G J-q, /2(0 G J"o, /a G ^o, 
and /i(fc) only depends on index fc, /2(0 only depends on index and /3 does not depends on index. 
For general case, to show how the variable depends on the indices, we define the following notations. 

Definition 5.13. Let Aj he a family of random variables where I is indices (vector), not including index a. 
we write 

Ai G n4';'> e {-^0, -^1/2, -^1, ^] 

i 

where Ii is part of I . if and only if there exists fi{Ii) G such that Aj = J^^ fiih) o-nd fi{Ii) only depends 
on the indices in li . 

For the example in we write Au G 4''' '4' where / (fc, I), h = (fc), h = (0 and h = (0), 

Q!i = a2 = and as = 

The following lemma shows the G's can be written as the polynomials in J^'s. 
Lemma 5.14. For simplicity, we introduce the notaion: 

41 - ^O^Xak + Tll'^Xka (5.70) 

Let w & and \ \z\ — 1| ^ 2e. Under the assumption of Lemma \3.Sl for any D > 0, we have 

XaGi«/),G„/3-F + 0^(iV-^) (5.71) 



and 



For any k ^ a, 



and, 



For any k,l ^ a, 



\aCraa G71 aT + 0^{N-^) (5.72) 
Xa(Gi«-))-^4^) er.j4%+4% + 0.{N-^) (5.73) 



XaGak G„ . / J-f;I • + {a + I3j) ^[014^1, + 0^(iV-^) (5.74) 



gm - Gir^ e„ (^f^4/'2-^S2 + /374'].452 + /374,'a-4/'2 + /3414,'x j -7^™ + o.(iv-^) (5.75) 

Furthermore, (j5.71[l - (|5.75p /loM uniformly for \\z\ — 1| ^ 2e, w & 1^ and 1 ^ k,l =/= a ^ N 
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X^St'' - E (jYT^^iZ'a^'r') + O.iN--) (5.79) 



Proof of Lemma \5.14\ Because one can easily check the uniformness, in the foUowing proof we will only 
focus on the fixed w, z, k and I. Recall (|4.25p and (|5.32p . with the assumption it) e and ||z| — 1| ^ 2e, 
we know the results in Lemma 15.61 and 15.71 hold under the assumption of this lemma. Furthermore, these 
results also hold for X^"'"^ (instead of X). 

1. We first prove (|5?7T|) . Applying Lemma [5?7I on X^"'""^, with and the first inequahty of 
(|5.58p . we have 

XaCi;'"^ e (5ki a + Iw-^It) -^0, and \w-'^\-i a (5.76) 

Then with 

Z[^^ = ((XG("^'')x^)aa - m^"^"^'^ (5.77) 

and a :~ Xa^''°''°'\ we have 

Xa{XG^''^''^X^)aaenaT and Xa^<"'e„a-F. (5.78) 
From (|5.6p and (|5.19p with i = a, T = a, we have 

y C(''^0) - Y — - 

Then with (|5.2ip . for any e,D > 0, there exists C^,/) depending e and D, such that 

V(l + m('^^'^))'' 

holds with 1-high probability. Hence with ((OS)) and zi"^ e„ m^'"''") J" in ((5?78)l . we obtain that 

XaGt''> G« ^^^ + 0^(7V-^) =/3^ + 0^(iV-^) (5.80) 

which implies (|5.7ip with the fact: Ga'a'^^ and c'^aa"'^ have the same behavior. 

2. Now we prove (|5.72p . From (|5.29p and (|5.4p . with i = a and T = 0, for any e, Z? > 0, there exists 
Cj^D depending e and D such that with 1-high probability, 

Note: 1 + rrig''^^ + Izp^Jaa'"'' is independent of the a-th column of X, but depends on the a-th row of X. 
From dSJl) and ((5l^ . we have 

Z„ = Z Y.{X^)a,gif^ +Z*Y: Sif^^>^^ + Y^^X^UQif^^la - 4"'^ - l-P^^ia (5-82) 
fe A; kl 

Now we claim that for any Z), 

Xa^a e„/3J" + 0^(iV-^) (5.83) 

and 

Xa (l + m^f'") + G„ J- + 0^(7V-^) (5.84) 
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Combining (jSTSSl . ((SlM)) and we obtain ({572)) . 

2. a We prove (|5.83p first. Using the Q version of (|5.63p and (|5.80p . we can write the first two terms of 
the r.li.s. of (|5.82p as we can write 

zj:(X^USt'^+-*T.Sif^^>^^ = (S^^^'^X) e„ l3jT (5.85) 

— — \ / aa 

k k 

Similarly for the third term of the r.h.s. of (|5.82p . using (|5.2p . we can write it as 

{x^gi^^^)xu = Y.^x^Ug^i''^ + (^t'^r' Y.^x^Ug^:fgifH,. (5.86) 

kl kl 

={^x^gMxu + iGt^Y' (g^^'^^x) (g(^-^^x) 

\ / aa \ / aa 

Using ([578]) , ((5?63ll and (ISlSO]) . we obtain 

Xa{X^g^'''®^X)aa &n aF + F , (5.87) 
For the fourth term of the r.h.s. of (|5.82p . using (|5.2p . we have 

^(a,0)^(a,0) 
^(a,a) _ ^(a,0) _ ^fcg ^ gk 
— Vk 



'kk ^kk i->{a,1l) 

ya 



iaa 



Together with (|5.62p . it implies that 



nig = 



^^^^ + ^^i"/^ [[XSSX'^)^^ + l) (5.88) 



and 



Now inserting these bounds back to (|5.82p and using the relations between a. /3 and 7 in (|5.55p and (|5.56p . 
we obtain (|5.83p . 

2.b Now we prove ((5^ . With ((5^ and 

{Gil'^^r' = + iXG^'''''^X^)aa) = -wil + m("'"' + Z("^) 

we write 

(gt'^V 

(5.89) 



( 


[gL'-a'^) 


1 


l+jn(°-») 1 1 1 




(^xssx^'j 


+1) 

aa / 


1 + kP 


g(a,0) + AT 1 



Ml + iXG(-'''^X^)aa) 



(-w(l + m(''^''))(l + m^'^''^)) + |z|2) + (^-w(l + m(''^"))Z(") + + l)^ (5.90) 



We write this denominator as 
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With ((5?2T|) . (I031) . ((5T7)) . we obtain that with 1-high probabihty 

Together with (|5.62p and (|5.56p . with 1-high probabihty, we can bound the second term of (|5.90p as 

Xa (^-i(;(l + m(''-''))Z(°) + 1 + 1)^ 7V-^/6 (5.91) 

On the other hand, we claim for some C > 0, the following inequality holds with 1-hight probability. 

Xa \-w{l + m('''''))(l + m("'")) + |z|2| ^ Xa(logiV)-^ (5.92) 

If ([O^ does not hold, then Xa 1 and 1 + m^"^'"^) = {-\z\ + o{\ogN)-'^)w-'^/'^ . With (gSJ), (jg:^ and 
||z| — 1| < 2e , we obtain 

1 + ni-g'^^ = (-|z| + o{\ogN)-^)w-^l^, (5.93) 
It follows from 1 + m'"'") = + o{\ogN)-^)w-^/'^ and ([O^ that 

^(-■0) = (|z|-i + o(log7V)-^)«;-i/2 (5.94) 
Inserting them into (|5.9p . with (|2.6p . we have 

=o(logiV)-^?i;-i/2 (5,95) 

Now insert and into ([53), we obtain |Gaa| ^ {\ogN)^\w\-'^/'^ for any C > 0, which 

contradacts (|5.14p . Therefore, (|5.92p must hold. 

Recall the denominator of the r.h.s. of (|5.89p equals to the sum of the l.h.s. of (|5.9ip . (|5.92p (see (|5.90p ). 
Then inserting (|5.9ip . (|5.92p into (|5.90p . we have that for any fixed D, there exists C^^d, such that with 
1-high probability, 

^^-pi^^^-...(l + (XG<».».X-,„„, (5.96) 



c^,o + ni'^---))zl^'^ + i ( (XSSXA + 1) ) 
y +0^{N 



* 

fc^i (-w(l + mi°-^°-')){l + m('^^'^)) + |z|2) 



fe-i 



For the terms in we apply ((5J8)) on {XG^"'"'^ X'^)aa and zi''^ apply ((5:23| on (1 + m^''^'')), apply 

([S:^^ on fx55X'^) , apply (jS^S]) on 7 and apply (|5.92p on the denominator of (|5.96p . we obtain 



(,.0)''; , en -Xa{wT + waF) ^ (-Wj- + 7^^)'-' +0^(iV-^) (5.97) 

1 -f rag + \z\ yaa k=i 

With the bounds of a and 7 in and ((?35)) . it implies ([g^M)) . Combining ((Oil) and 

we obtain (j???^ . 

3. For ((5J3)) . it clearly follows the Def. [5lT1 ((5J0| and Def. [5T3l 
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4. Now we prove (|5.74p . First with (|5.6p and (|5.12p . we have 

{Qaa)-' = + {YG^®'-'^Y^)aa). (5.98) 

Applying (|5.3p on Gak with i = a, recaUing Y ^ X — zl, we have 

Gak =G^^ + wGaa ((G(«-")X^),, - z*G(«/)) ({XG^'^^\u " ^cit'"^) (5.99) 

- Z*wgaaGiY\XG^^-''^)ak + wQaaiG^^^^^ X^)aa{XG^^-''^)ak 

Writing the first term in the last line as G^^j!"'^ Gaa{Gaa)^^ and applying (|5.98p on {Gaa)~^, with Y ^ X — zl, 
we can write the first three terms in the second line of (|5.99p as 



(-1- (XG(®^")X^)aa + z*(XG(0'''))„,) wGaaG^!rl''^ 



Therefore 



G.. = (-1- {XG^^^^^X'^U + Z*{XG^'^^\a) wGaaG^f^ + (-^*Gi^) + [G^'^^'^^X^U) wGaa{XG^'^'^\, 

(5.100) 

Inserting ([E7T|) - ((g75)) . (g^, (H^, the fact: a/3 = Xa and ([EBH)) into (jS.lOOp . we have 

XaGak e„ (1 + a + /37 + /372) J"!®! (^^F^J^ + J"!"],) + (1 + 7) -F[''l(XG(®''^))afc + 0^(^-^) (5.101) 
More precisely, here what we used is the G — version of (|5.85p . (|5.87p . i.e., 

{XG^^''''>)aa G„ h^F and Xa(^G(0^'^)X^),, e (a + /372)J-. 
They follows from (|5.85p . (|5.87p and the symmetry between G and G- Next using (|5.58p . we have 

XaGak e„(a + /37)-^™ (7-^1/2+44) +J'^^\XG^^^-^)ak + 0^{N~'') (5.102) 
SnXa^^-Ff;' • + (a + /37) • 4i + Xa(XG(«-))..^[«l + 0.(iV-^) 

For (XG(®'°))Qfc in (|5.102p . using for 7^ a we have (note: s can be a) 

^(0,a)^(0,a) 
^(a,a) _ ^(0,a) _ '-^^.a "-^afc 
sk '-^sk ^(0.a) 

Together with I^Mi, ([^TT]) and it implies that 

Xa(XG(0-)),fe ^ Xa{XG^^-^\k + Xa^^^J^Git'") (5.103) 
e„ Xa(XG(''''')),, + /37'^['1 • 4% + /^T-^™ • + OAN-"") 
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It follows from (|576)) . (note: ^ ai/2(7Vr;)-i/2) that 



1/2 



Inserting it into (|5.103p . with Lemma [5. 101 we obtain 



N-q 



(5.104) 



Together with (|5.102p . we obtain (HTJ). 



5. Now we prove ((5J5)l . With (|5.104p . ((5J3)) and Lem. [STTOl we have 

X„ ((G(«^'^)X^),, - z*Git'"') e„ . + /3J-1«1 J-f], + 0^(iV-^) (5.105) 

Together with (jO)) . (|5?g5| . (|5?7T|) and (|537| . we can write Gki as follow, 

Xa (g.z - Gi^)) =xaz«e.. ((G(«-)X^),. - z*Gi«/^) ((XG(«-))., - zGi^)) (5.106) 

i_ x-W ttW 7r[01 _u fl., ttW TtW _u TtW ttW _u ttW TtW TtM _u n (AT-D-, 

"Nr] 



Furthermore, with (|??7T|l . ([??75)) and (|?37)l . we can write G^.'J'"'' as 

^(0,a)^(0,a) ^{0,a) ^(0,a) 

^(0,a) _ ^{a,a) _ kg al _ ^{lfl,a) 'fka. ^ al (r -, ^71 

^kl ^kl ~ (0^a) -^aa (0.a)„(0,a) [O-WI) 

Therefore, together with (|5.106p . we obtain (|5.75p . 

□ 

Next, we write the terms appeared in the l.h.s. of (|4.26p as polynomials in J-1/2 and ■ F (with 
proper scale factors and ignorable error terms). 

Lemma 5.15. Let w e and \\z\ — 1| ^ 2e. Under the assumption of Lemma \8.'A for any fixed large D > 0, 
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with Xa defined in (j4.24p and F^'^l^ defined in (|5.70p , we have that for k ^ a 

Xa(m-m(°'°)) e„ -^-F + 0^(iV-^) (5.108) 
XaGbb e„ + O^iN-"") (5.109) 

Xa{YG)aaenT+0^{N-'') (5.110) 

Xa(rG)„fc e„ ■ + 44-^"" + 0^{N-% (5.111) 

Xa(rG2),be„ ^j-^/2.^ + Xb,J- + 0^(7V-^). (5.112) 

Xa{G^)aa + ©^(TV^^) (5.113) 

Xa(G2)bb e„ /37r'-^ + (A^"'') (5.114) 
XaiYG^Y*)aa — J-+0^(A^-^) (5.115) 

Proof of Lemma [^T5[ 1. For (|5.108p . using (|5.75p and (|5.72p . we have 

Xa{m - mf'^^'^)) = ^G,, + Xa E (g^, - G^r^) (5.116) 

Here for the last S„, we used 

5Z ]v'"^i/2-^i/2 ^ 5Z ■^o.ls:-^i/2 ^ 5Z ■^o.lf-^o,!: ^ (5.117) 

k^a k^a k^a 

Then with ([535)) and ((5?56| . we obtain (|5.108|) . 

2. For (|5.109p . it follows from (|??75)l . J"i/2 • ^"1/2 C J" and the fact: Xab = that 

XaGbb Gn XaG[r^ + + /^T^ba J"l/2 ' ^ + ^XbaXbaT (5.118) 

where we used (Oil) on g|,;;'°'. Now using Lemma [STTUl we obtain (|5.109p . 

3. For (jS.llOp . with ((0|) and ((08)) . we can write it as 

Xa{YG)aa = "XaU-^aa (l^G^®''') ),, = ^XaWQaa ((^G^"''^) ),, - zG^^f^) (5.119) 

Then with ([ET^ . ((?TT|) and dUg), we obtain (|5.110p . 
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4. Now we prove (|5.111[) . with (|5.3p and (|5.98|) again, we write it is 

{YG)ak = -wgaa{YG^^'''^)ak = -wQaa ((XG'^''^) )afc - zG\ 

Then using (|5.105p and ([5T72)) . we obtain (|5.111|) . 

5. For (|5.112p . by definition, we write {YG'^)ab as 



ak 



{YG'')ab = ^(>^G)afeGfe6 + {YG)aaG 



ab 



Then using (|5.11ip . ^l^il- with = 0, we get 

Xa Y.{YG)akGkb 



(5.120) 



(5.121) 



(5.122) 



ky^a 



1/2 



With ()5.117p and Lemma [STTOl we obtain 



ba 



(5.123) 



Then applying ((576| on G),'^'''\ we obtain GH'"' € (Iwr^/^^ + 46a) Jo- Now with 

k k 

and Lemma 15.101 again, we get 

Xa J2{YG)akGkb e„ ^ (-^j/'2-^f''^ + -^'"l^fea 
k^a ^ 

Similarly, with (|5.110p . (|5.74p and Lemma [5. 101 again, we obtain 

XaiYG)aaGat ^ (rfj^F^^^ + F^'^ X^a) 



(5.124) 



(5.125) 



and we obtain (|5.112p . 

6. For (|5.113p . we write {G'^)aa as 



(G^)aa — GakGka + (Gqq)^ S„ GakGka H -7^ 



where for the second €„, we used (|5.72p and ()5.55p . As in ()5.122l) . using ()5.74p and (|5.117p . we have 

E GakGka = E (\[^A% • + + /57) • 4^],) ' 

fe^a k^a \ * ' / 



(5.126) 



(5.127) 



e„ + (« + /?7)' ) 
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Then with Lemma FS-lOi we obtam (|5.113|) . 
7. (|5.114p , we write it as 

{G^)bb = ^ Gbk.Gkb + (Gbb)^ + {GabY 
k^a,b 

With (15751) . (|5lT7| and E/c-^"'''''' ^ ^-^"^ (" = 0,1/2,0), after a tedious calculation, we get 

GbkGk 



'kb 



(5.128) 



(5.129) 



k^a,b 



k^a,b 



a , 



/ / " -p[fe.6] Xa ^[fe] ^[fc] , / ^[fe] ^[6] ^[6] ^[fe] \ ^ -plk] -plb] \ -p 
/ . I V /Vr7 ° + /v„ 1/2-^1/2 P' l-^0,X-^l/2 •^0,X-^l/2 i P-^0,X-^0,X ) 



1 ra 



AT?? 



7y \ ^ V 



Then using 

Lemma Eini •^i/2-^i/2 ^ J^, XbaJ'^'j^ e T and e J", we obtain 



/2 



(5.130) 



Similarly, using (|5.75p . and Lemma 15.101 we have 



GbbGbb&.^ (« + ^+/?7 + /3) J- + 0^(iV-^) G„ ^J- + 0^(iV-^) 



Using (|5.72p . and Lemma FS.lOl we have 

which completes the proof of (|5.114p . 
8. For (|5.115p . it follows from 

{YG'Y^)„.„.=Q„.„.^w{Q'')„.„. 

and ^^1% and (imi) . 

Now we are ready to prove Lemma |4.9| which is the key lemma of the proof of our main result. 



(5.131) 



(5.132) 
□ 



5.4 Proof of lemma [4l9l First with m — m*^"'"-* = 0(Nr\) ^ (see (|4.3p ) and the definition of Xa, for any 
fixed £> > 0, with 1-high probability, we can write the h{tx) as 



, , , ./X "^-^l.^t-i/ X /Rem — Rem(°'") 



fe=0 



OiN 



(5.133) 
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where C^.d depends on e on D and /i'*^-' is the k — th derivative of h. Using (|5.108p and the fact that h is 
smooth and supported in [1, 2], we obtain 



Mix) e„^ + 0^(iV-^) (5.134) 

and 

Htx) - h{tx<...a> ) e„ N-'l{\txi...} K 2)^ + (iV-^) (5.135) 

Similarly, one can prove 

h'itx), h"{tx), /i"'(tx)e„l(|tx(».<.)K2)^ + 0^(7V-^) (5.136) 
Using (lESl, (|5l^ and ([5T^ . we have 

(/i(tA-)Rcm-/i(tx(","))Rem('''")) e„ (/i(tA-) Rc m^"'") - /i(tA(.,„) ) Re m^'^-'^)) + _i_ J- + O(iV--D) 

T^-^ + 0^(^"'') (5.137) 

It implies (g^. 

Recall Bn(X) is defined as 



i?„(X) := l(Ari-=r;)("-i) (nh^^-'\tx) + h^''\tx)tx) (5.138) 
Then using (jOM)) . (jST^ and (jSHp . we obtain (jOT)) . 



Similarly, using (|5.112p . ([5T^ . (|5.114p . (|5.112p . (|5.115p and (|5.109p . we obtain and complete the 

proof. 

□ 
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